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A generalization of the Onsager-Machlup theory from equilibrium to nonequilibrium steady states 
and its connection with recent fluctuation theorems are discussed for a dragged particle restricted 
by a harmonic potential in a heat reservoir. Using a functional integral approach, the probability 
functional for a path is expressed in terms of a Lagrangian function from which an entropy pro- 
duction rate and dissipation functions are introduced, and nonequilibrium thermodynamic relations 
like the energy conservation law and the second law of thermodynamics are derived. Using this La- 
grangian function we establish two nonequilibrium detailed balance relations, which not only lead 
to a fluctuation theorem for work but also to one related to energy loss by friction. In addition, we 
carried out the functional integrals for heat explicitly, leading to the extended fluctuation theorem 
for heat. We also present a simple argument for this extended fluctuation theorem in the long time 
limit. 
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I. INTRODUCTION 

Fluctuations play an important role in descriptions 
of nonequilibrium phenomena. A typical example 
is the fluctuation-dissipation theorem, which connects 
transport coefficients to fluctuations in terms of auto- 
correlation functions. This theorem can be traced back 
to Einstein's relation 0, Nyquist's theorem Mil, On- 
sager's arguments for reciprocal relations 0,0 Eh ctc -' 
and it was established in linear response theory in 
nonequilibrium statistical mechanics near equilibrium 
EJ Another example of fluctuation theories is 
Ons a ger- M achlup ' s fluctuation theory around equilib- 
rium Ull Hif . It is characterized by the usage of 
a functional integral technique for stochastic linear re- 
laxation processes, and leads to a variational principle 
known as Onsager's principle of minimum energy dis- 
sipation. Many efforts have been devoted to obtain a 
generalization, for exam ple, to the cases of nonlinear dy- 
namic s [Hi. IbS. El El Il7| and nonequilibrium steady 
states Elllllm^ 



Recently, another approach to fluctuation theory lead- 
ing to fluctuation theorems has drawn considerable at- 
tention in nonequilibrium statistical physics [2ll El Ei| . 
They are asymmetric relations for the distribution func- 
tions for work, heat, etc., and they may be satisfied even 
in far from equilibrium states or for non-macroscopic sys- 
tems which are beyond conventional statistical thermo- 
dynamics. Originally they were proposed for determin- 
istic chaotic dynamics, but they can also be justified 
for stochastic systems [3 IH, IH, Moreover, lab- 

oratory experiments to check these fluctuation theorems 
have been made El El El El HI El . 



From our accumulated knowledge on fluctuations, it is 
meaningful to ask for relations among the different fluctu- 
ation theories. It is already known that the fluctuation- 
dissipation theorem, as well as Onsager's reciprocal re- 



lations, can be derived from fluctuation theorems near 
equilibrium states [2ll El Ei| . The heat fluctuation the- 
orem can also be regarded as a refinement of the second 
law of thermodynamics. 

The principal aims of this paper are twofold. First, 
we generalize Onsager and Machlup's original fluctua- 
tion theory around equilibrium to fluctuations around 
nonequilibrium steady states using the functional integral 
approach. For this nonequilibrium steady state Onsager- 
Machlup theory we discuss the energy conservation law 
(i.e. the analogue of the first law of thermodynamics), the 
second law of thermodynamics, and Onsager's principle 
of minimum energy dissipation. As the second aim of this 
paper, we discuss fluctuation theorems based on our gen- 
eralized Onsager-Machlup theory. Since the systems we 
consider are in a nonequilibrium steady state, the equilib- 
rium detailed balance condition is violated. We propose 
generalized forms of the detailed balance conditions for 
nonequilibrium steady states, which we call nonequilib- 
rium detailed balance relations, and show that the fluc- 
tuation theorem for work can be derived from it. To 
demonstrate the efficacy of nonequilibrium detailed bal- 
ance as an origin of fluctuation theorems, we also show 
another form of nonequilibrium detailed balance, which 
leads to another fluctuation theorem for energy loss by 
friction. We also show how a heat fluctuation theorem 
can be derived from our generalized Onsager-Machlup 
theory, by carrying out explicitly a functional integral 
and reducin g it s derivation to a previous one discussed 
in Refs. |35ll36j. In addition, we give a simple argument 
leading to the long-time (t — ► +00) fluctuation theorem 
for heat, based on the independence between the work 
distribution and the energy-difference distribution. 

In this paper, in order to make our arguments as con- 
crete and simple as possible, we apply our theory to a spe- 
cific nonequilibrium Brownian particle model described 
by a Langevin equation fcf. 1 3711. It has been used to dis- 
cuss fluctuation theorems |3.4 1.Sfil El El Efij , and also to 
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describe laboratory experiments for a Brownian particle 
captured in an optical t rap which moves with a constant 
velocity through a fluid [23, , as well as for an electric 
circuit consisting of a resistor and capacitor [3^, |SJ . 

The outline of this paper is as follows. In Sec. [H] we 
introduce our model and give some of its properties using 
a functional integral approach. In Sec. IIIII we discuss a 
generalization of Onsager-Machlup's fluctuation theory 
to nonequilibrium steady states, and obtain the energy 
conservation law, the second law of thermodynamics, i.e. 
a nonequilibrium steady state thermodynamics, and On- 
sager's principle of minimum energy dissipation for such 
states. In Sec. IIVI we introduce the concept of nonequi- 
librium detailed balance, and obtain a fluctuation the- 
orem for work from it. In Sec. [V] we discuss another 
type of nonequilibrium detailed balance, which leads to 
a fluctuation theorem for energy loss by friction. In Sec. 
IVII we sketch a derivation of a fluctuation theorem for 
heat by carrying out a functional integral and reducing it 
to the previous derivation [35L l36| . In addition, we give a 
simple argument for the heat fluctuation theorem in the 
long time limit. In Sec. IVIII we briefly discuss inertial 
effects on the fluctuation theorems, which lead to four 
new fluctuation theorems. In Sec 



Villi we summarize 
our results in this paper and discuss some consequences 
of them. 



II. DRAGGED PARTICLE IN A HEAT 
RESERVOIR 

The system considered in this paper is a particle 
dragged by a constant velocity v in a fluid as a heat 
reservoir. The dynamics of this system is expressed as a 
Langevin equation 42] 



d 2 x t 
1 dt 2 



dx t , 

-a— k (Xt 

dt y 



vt) + Ct 



(1) 



for the particle position xt at time t in the laboratory 
frame. Here, m is the particle mass, and on the right- 
hand side of Eq. the first term is the friction force 
with the friction constant a, the second term is the har- 
monic potential force with the spring constant k to con- 
fine the particle, and the third term, due to the coupling 
to the heat reservoir, is a Gaussian- white noise Ct, whose 
first two auto-correlations are given by 



(Ct) = 0, 

In 

(CM = -jSfa 



(2) 
(3) 



with the inverse temperature (3 of the reservoir and the 
notation (■ ■ • ) for an initial ensemble average. The coef- 
ficient 2a //3 in Eq. (|3J) is determined by the fluctuation- 
dissipation theorem, so that in the case v = the sta- 
tionary state distribution function for the dynamics Q 




> x 



FIG. 1: Schematic illustration for a particle trapped by a 
harmonic potential dragged with a constant velocity v in a 
reservoir. Here, x and y (0; and C ) are the axes (the origins) 
for the laboratory and comoving frame, respectively, in the 
direction of the motion of the particle. The particle is at 
the position yt (xt) at time t in the comoving (laboratory) 
frame, respectively, which are related by y t = xt — vt. After 
the relaxation time t, the system will reach a nonequilibrium 
steady state. 



is expressed by a canonical distribution. A schematic 
illustration for this system is given in Fig. ^ 

In this paper, except in Sec. IVIII we consider the 
over-damped case in which we neglect the inertial term 
md 2 Xt/dt 2 , or assume simply an negligible small mass 
m. Under this over-damped assumption, the Langevin 
equation JQ) can be written as 



dxt 1 , , 1 

-7T = (Xt-Vt) + -Q 

at t a 



(4) 



with the relaxation time r given by r = aj k. 

Equation (0} is for the position xt in the laboratory 
frame. On the other hand, it is often convenient or sim- 
pler to discuss the nonequilibrium dynamics in the co- 
moving frame [4(1 |43| . The position y t in the comoving 
frame for the particle in our model is simply introduced 
as 



y t =x t - vt. 

Using this position y t , Eq. @ can be rewritten as 
1 



dy t 
dt 



--y t 

T 



±4, 

a 



(5) 



(6) 



whose dynamics is invariant under the change yt — > —yt 
and v — > —v, noting that the Gaussian-white noise prop- 
erty of Ct is not changed into Ct — > — Ct- Note that 
in the comoving Langevin equation © there is no ex- 
plicit £-dependent term in the dynamical equation, while 
the laboratory Langevin equation has a t-dependence 
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through the term vt, meaning Eq. JBJ to be a little sim- 
pler than Eq. The constant term — v in Eq. © 
expresses all effects of the nonequilibrium steady state in 
this model. 

The system described by the Langevin equation @ , or 
equivalently Eq. approaches a nonequilibrium steady 
state, because the particle will, for t > r, move steadily 
due to the external force that drags it through the fluid. 
This force is given by — ny t , so the work rate W^ v \yt) to 
keep the particle in a steady state is expressed as 



-ny t v. 



(7) 



We note that since W^°'(yt) = for v — 0, i.e. for the 
equilibrium state considered by Onsager and Machlup, 
there is no work done, while in the nonequilibrium steady 
state for v ^ work is done |4^. 

We consider the transition probability F( yt \ yo ) of the 

t t 

particle from j/o(= Vt ) a t time t Q to y t at time t, which 
is introduced as a transition integral kernel for the prob- 
ability distribution /(j/t,t) at the position y t at time t 



f(yt,t) = dy F 



f(yo,t ) 



(8) 



with the initial distribution f(ya,to). We can use vari- 
ous analytical techniques, for example the Fokker-Planck 
equation, whose solution gives the probability distribu- 
tion f(y t , t) , to analyze the transition probability 
for the dynamics expressed by the Langevin equation . 
As one such technique, motivated by Ref. [llLIT^I . we use 
in this paper the functional integral technique 17]. Using 
this technique, the transition probability is represented 



F 



Vi 



yt 



T>y s exp 



dsL^(y s ,y s ) 



la 



(9) 



where L^ v \y s ,y s ) is the Lagrangian function for this 
stochastic process, defined by 



4D\ ys+ r Vs 



(10) 



where D is the diffusion constant given by the Einstein 
relation D = 1/ (a/3) . [We outline a derivation of Eq. 
© from Eq. © in Appendix 1X1] Here, the functional 
integral on the right-hand side of Eq. 10 is introduced 

as 



Vy s X t ({y s }) 



lim . 



N/2 



dyt 



dy t 



dy tl X t ({y s }) 



(11) 



for any functional X t ({y s }), with t n = to + nAtpf, 
n = 1,2,- •• ,N, At N = (t - t )/N, the initial time 
to, the final time tjq — t, the initial position y$, and 
the final position y t . Here, we use the symbol {y s } in 
X t ({y s }) to show that X t ({y s }) is a functional of {y s } 
with s € [^Oj^]- It is important to note that from the 

representation (0 of the transition probability F( Vt | ) 



the functional exp[J^ ds L^ v \y s , y s )] can be regarded as 
the probability functional density of the path {ys} S £[t ,t}- 
For the Lagrangian function (|10fl . the functional inte- 
gral on the right-hand side of Eq. © can actually be 
carried out using Eq. (|llf) . to obtain, by a simple gener- 
alization of the well-known equilibrium (v = 0) case, 



F 



Hi 



1 



x exp 



[yt + vt- (y + vt) b t Y 



(12) 

where bt and % are defined by bt = exp[— (t — to)/T] and 
%_ = (r/2)(l - b 2 t ) so that % - t - t + 0((t - t ) 2 ) 
|46| . Equation l|12(l is simply a well known form of the 
transition probability for the Smoluchowski process |l7| . 
Inserting Eq. (|12fl into Eq. ijSJ, using the normalization 
condition J dyo f(yo,to) = 1, and taking the limit t — > 
+oo, we can show that for an arbitrary initial distribution 
f(yo,to), the probability distribution f{yt,i) approaches 
to a nonequilibrium steady state (ss) distribution: 

fssijjt) = t lim f(y t ,t) = f eq (yt + vt) (13) 

t — ^+oc 

in the long time limit. Here, f eq (y) is the equilibrium 
distribution function given by 



fM = \hre*p[-PV(v)] 



(14) 



with the harmonic potential energy U (y) = ny 2 /2. Equa- 
tion l|13JI implies that the steady state distribution f ss (y) 
is simply given by the equilibrium canonical distribution 



f £ q(y) by shifting the position y to y 



[Note that 



there is no kinetic energy term in the canonical distribu- 
tion (|14(l under the over-damped assumption.] Equation 
(|13|l implies that the average position of the particle is 
shifted from the bottom y = of the harmonic potential 
in the equilibrium state to the position y — —vt in the 
nonequilibrium steady state. 

The functional integral approach has already been used 
to describe relaxation processes to thermal equilibrium 
with fluctuations and averages by Onsager and Machlup 
[ill Il2| . In the next section, we generalize their argu- 
ment to non-equilibrium steady states for our model, and 
construct a nonequilibrium st eady state thermodynam- 
ics. The results in Refs. 0, Il2j can always be repro- 
duced from our results in Sec. IIHI by taking v = 0, i.e. 
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in the equilibrium case. In this generalization, we de- 
termine the work to sustain the nonequilibrium steady 
state in the Onsager-Machlup theory, and also give a di- 
rect connection between the entropy production rate in 
the Onsager-Machlup theory and the heat discussed in 
Ref. EEL 



III. ONSAGER-MACHLUP THEORY FOR 
NONEQUILIBRIUM STEADY STATES 

In the generalized Onsager-Machlup theory, the La- 
grangian L^"'(y s ,y s ) can be written in the form 

L^(y s ,y s ) =-J- [& v \y s ) + 9 fa) - S<"> (y a ,y s ) 

(15) 

where is the Boltzmann constant, and $( v '(y s ), ^(y s ) 
and S^(y s ,y s ) are defined by 



•<*>-£(*) 

S {v) (ys,y s ) = 



-ny s (y s + v), 



(16) 
(17) 
(18) 



respectively, with the temperature T = (fcs/3) -1 . These 
functions & v '(y s ) and Vl'(ys) are called dissipation func- 
tions, while we call S^(y s ,y s ) the entropy production 
rate. In the next subsections IIII Al and IIII 51 we discuss 
the physical meaning of these quantities, and justify their 



A. Heat and energy balance equations 

Using the entropy production rate S^ v ' (y s ,y s ), we in- 
troduce the heat Q^ v ({y s }) produced by the system in 
the time- interval [to,t] as 

Q[ v) ({y s })^T f dsS^(y s ,y s ). (19) 
Jt 

On the other hand, the work wj: v \{y s }) done on the 
system to sustain it in a steady state is given by 



W { t v) ({y s })^ dsW^(y s ). 

J to 



(20) 



using the work rate J7J). The heat l|19|) and the work 12U|) 
are related by 

Qi v) ({y s }) = M V \{Vs}) - AU(y u y ) (21) 
with the internal (potential) energy difference 

AU(y t ,y ) = U(y t )-U(y Q ) (22) 



at times t and to. The relation l|21|) is nothing but the en- 
ergy conservation law satisfied even by fluctuating quan- 
tities. It may be noted that Eq. 112111 is used as a "defi- 
nition" of heat in Ref. |35l l36| , while here it appears as 
a consequence of our nonequilibrium Onsager-Machlup 
theory. In other words, our generalization of the Onsager- 
Machlup theory gives a justification of the heat used in 
Ref. [H, H(|. For other attempts to justify the energy 
conservation law in stochastic processes u sing a Langevin 
equation or a master equation, see Refs. |27L l37| . 



B. Dissipation functions and the entropy 
production 

First, it follows from Eqs. iJToJl and (fTHf) that 

&- v \-y s ) = *< v Hv.), (23) 

&- v) (-v.,v.) = -s {v \ys,y s ), (24) 

implying that the dissipation function $w (y s ) [as well as 
^Kfs) by Eq. 1)1 7p] is invariant under the time-reversal 
changes y s — > —y s and v — > — v, while the entropy pro- 
duction rate S^ v \y s ,y s ) is anti-symmetric under these 
changes. It is also obvious from Eqs. I|16|> and l|17fl that 



$M(y s 



> 0, 

> 0, 



(25) 
(26) 



namely, that the dissipation functions are non-negative. 
One should also notice that by the definitions (|16l) and 
(|T7|l the dissipation functions & v ^(y s ) and ^(y s ) are pro- 
portional to the friction constant a. 

Second, from Eqs. (0) and ©, the ensemble average 
(y s ) of the particle position y s satisfies 



:(y« 



(27) 



with the time-derivative y s = dy s /ds of y s , leading to 
(y s ) = -vr + ((y ) + vr)exp[-(s - t )/r]. Using this 
average position (y s ) and the average velocity (y s ), it 
follows from Eqs. l(To]l. (fTTfl and that 



& v \(y s )) = H(ys))- 



(28) 



Namely, the two dissipation functions ^ v \y s ) and ^(y s ) 
have the same value for (y s ) and (y s ), although & v '(y s ) 
is a function of y s and ^(y s ) is a function of y s . Moreover, 
from Eqs. JTSJl, JTSJl, J2ZJl and @ we derive 

S^((y s ), (y s )) = 2$W«tf.)) = 2*«</ s » > 0, (29) 

namely, the function 2$^((y s )) [as well as 2\f r ((y s ))] 
gives the entropy production rate S^ v '({y s ), (y s )), justi- 
fying the name "dissipation function" for & v \y s ) and 
\l/(j/ s ). The inequality in l|29|) is the second law of ther- 
modynamics in the Onsager-Machlup theory. 
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C. Onsager's principle of minimum energy 
dissipation and the most probable path 

Equation i|27|l for the average (y s ) of the particle posi- 
tion can be derived from the variational principle 



& v) (y s ) + *(ys)-S^(y s ,y s ) 



minimum. 



(30) 



without using the Langevin equation ©. This can be 
proved by using that <5^(y s ) + &(y s ) - S^ v \y s ,y s ) = 
-2k B L^(y s ,y s ) > and L^((y s ),(y s )) = 0, so that 
the left-hand side of Eq. (|3U[) takes its minimum value 
for y s = (y s ), i-e. for the average path, which is used in 
Eq. (|29[l. Equation (fST7f> is called the Onsager's princi- 
ple of minimum energy dissipation, and is proposed as a 
generalization of the maximal entr opy pri ncip le for equi- 
librium thermodynamics 0, U HJ E2 El H E3 

Another result in the Onsager-Machlup theory as a 
variational principle is that we can justify a variational 
principle to extract the special path {yt}se[t ,t}i the so- 
called most probable path, which give the most significant 

contribution in the transition probability F( Vt \ y °). By 

t t 

the expression © for the transition probability F[ Vt \ Vo ), 

t t 

the most probable path {ys}s£[t ,t} is determined by the 
maximal condition on f t ds L^(y s ,y s ), in other words, 
the path {y s } s e[t ,t] satisfying 



ds 



to 



^ v) (y s ) + *(ys)~S iv) (y s ,y s ) 



minimum, 



(31) 



under fixed values of yo and yt, noting the expres- 
sion (|15|l for the Lagrangian function L^(y s ,y s ). The 
condition Ij31|l . or equivalently the maximal condition 
of J t ds L^ v '(y s ,y s ) implies the variational principle 

S Jt'o ds = for the P ath {ys}se[t ,t}, leading 

to the Euler-Lagrange equation 



d dL^(y*s,yt) dL^(y* s ,y* s ) 



ds 



9y* s 



9y* s 







(32) 



for the most probable path {ys}se[t .t]- (The most prob- 
able path can also be analyzed by the Hamilton- Jacobi 
equation [H,[l3-) Inserting Eq. JTJJ into Eq. we 
obtain 



d 2 y* s 

ds 2 



y* s +vr 



(33) 



for our model. It is interesting to note that the en- 
semble average (y s ) also satisfies Eq. (|33fl . because 
d 2 (y s )/ds 2 = ((y s ) + vt)/t 2 from Eq. l(27jl. In gen- 
eral, the most probable path {yt}se[t ,t] with the con- 
ditions yl o — yo and y% = yt contains a superposition 

of the forward average path xi + ' = A+ exp(— s/r) — vr 



(like the average path (yt)) and its time-reversed path 
t[ ' = A- exp(s/r) + vr, namely 



(34) 



where A± and Aq(= —vt) are time- independent con- 
stants and are determined by the conditions y% = ya 
and y* t =y t 0. 

We now discuss a relation of the Onsager-Machlup the- 
ory with Einstein's fluctuation formula [50| . We note that 



L (v)fj[+] jr lA 



= o, 



Kr \ 



(35) 
(36) 



with Tg = dTs/ds. Here, we used the equation 
±dT^ / ds = — T^'/r =F v. Using the most probable 
path {y*}se[t ,t} satisfying the conditions y* t(j = y and 
y^ = yt, we can approximate the transition probability 

<i:°)as 

t tn 



exp 



L^(y* s ,y* g ) 



(37) 



apart from a normalization factor. This is analogous to 
the classical approximation for the wave function in the 
Feynman path-integral approach in quantum mechanics 
[5lJ . It is meaningful to mention that in the case of relax- 
ation to an equilibrium state (v = 0), Eq. (|37|l becomes 



yt 



yo 

exp 



v=0 

1 

V 



ds 



B Jt 



v=0 



,(38) 



noting Eqs. 
Eq. 138|) the transition probability F{ 



and LW(y* s ,y* s )\v=o = 
Here, we remark that in 



t 't 



u=0 IS 



expressed by the time-reversed path {T s } s &[t ,t] only. 
The quantity f t ds S gives the entropy, so that Eq. 
(|38|l corresponds to Einstein's fluctuation formula in 
equilibrium, i.e. for v = 0. 

IV. FLUCTUATION THEOREM FOR WORK 

In the preceding section II I II by generalizing the 
Onsager-Machlup theory to noncquilibrium steady 
states, we discussed fluctuating quantities whose averages 
give thermodynamic quantities, like work and heat, etc. 
Since these quantities fluctuate, it is important to dis- 
cuss nonequilibrium characteristics of their fluctuations. 
In the remaining part of this paper, we discuss such char- 
acteristics using distribution functions of work, heat, etc., 
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by the functional integral technique. For this discussion, 
generalized versions of the equilibrium detailed balance, 
which we will call nonequilibrium detailed balance re- 
lations, play an important role, leading to fluctuation 
theorems. Fluctuation theorems are for nonequilibrium 
behavior in the case of v 7^ 0, so there is no counterpart 
to the contents of this paper in Onsager and Machlup's 
original papers where v = always. 



A. Nonequilibrium detailed balance relation 

The equilibrium detailed balance condition expresses 
a reversibility of the transition probability between any 
two states in the equilibrium state, and is known as a 
physical condition for the system to relax to an equilib- 
rium state [rR lifij . This condition has to be modified 
for the nonequilibrium steady state, because the system 
does not relax to an equilibrium state but is sustained in 
an nonequilibrium state by an external force. This modi- 
fication, or violation, of the equilibrium detailed balance 
in the nonequilibrium steady state is expressed quantita- 
tively for work by 



(39) 



in our path-integral approach, which is derived from Eqs. 
l[TU)l. tnj and ipUjl, We call Eq. J3?JJ| a nonequilibrium de- 
tailed balance relation for nonequilibrium steady states in 
this paper [5^ • Equation (|39|l reduces to the equilibrium 
detailed balance condition in the case v = 0, because 
from Eqs. ©, Qg) and W t (0) ({y s }) = 0, we can derive 
the well-known equilibrium detailed balance condition 



F 



( Vt 


yo \ 


V 


to J 



feqiVo) = F\ 



for the transition probability F( y 



(yo 


yt\ 




to J 



f eq (yt) (40) 



in equilibrium. 



As discussed in Sec. |HJ the term exp[/ 4 * ds i^^(y s , y s )] 
on the left-hand side of Eq. I|39f) is the probability func- 
tional for the forward path {y s } s e[t ,t]- On the other 
hand, the term exp[ J t ds L^~ v \—y s ,y s )] on the right- 
hand side of Eq. (|39|l is the probability functional of 
the time-reversed path. Therefore, Eq. I|39l) means 
that we need the work W t ({y s }) so that the particle, 
dragged from an equilibrium state with the velocity v, 
can move along a path {y s }s£[t ,t] an d return back to 
the equilibrium state along its time-reversed path with 
the reversed dragging velocity —v. Such an additional 
work appears as a canonical distribution type of bar- 
rier exp[— j3W[ v ^ {{ys})] for the transition probability on 
the left-hand side of Eq. (|39|l . It should be emphasized 
that Eq. I|39|) is satisfied not only for the most probable 



path but for any path {y s }se[t ,t] , which is crucial for 
the derivation of the work fluctuation theorem as we will 
discuss in the next subsection IIV Bl 



B. Work fluctuation theorem 

Now, we discuss the distribution of work. For sim- 
plicity of notation, we consider the dimensionless work 
/3Wf V \{y s }) and its distribution P W (W, t) given by 

P w (W,t) = (S(W - (3W { t v) ({y s }))) t . (41) 

Here, ((• • -)) t means a functional average over all possible 
paths {y s }se[t ,t] > as wen as integrals over the initial and 
final points of the path: 

(X t ({y s }) \ = [ dyt 1^ Vy s I d yo A ds 



x f(y ,to) X t ({y s }) 



(42) 



for any functional X t ({y s }). It is convenient to express 
the work distribution P w (W,t) as a Fourier transform 



1 f +oa 

P w {W,t) = — d\e iXW £^{i\,t) (43) 

27T J -00 

using the function £ ffl (A, t) defined by 

£^(X,t)^{e-^^) t , (44) 

which may be regarded as a generating functional of 
the dimensionless work. It follows from Eqs. Q42JI. 
O, L(-\y s ,y s ) = L^(-y s ,-y s ) and W^tty*}) = 
Wj ({— J/s}), that the function £^\\, t) is invariant un- 
der the change v — > — v, namely 



£i- v \X,t) = £^(X,t), 



(45) 



if the initial distribution f(yo,to) is invariant under spa- 
tial reflection, namely /(-yo, t )\- v = /(yo,*o)|w This 
is simply due to an invariance under space inversion of 
our model. 

In addition, as shown in Appendix [Bj the nonequi- 
librium detailed balance relation (|39l) imposes the rela- 
tion £^ (A, t) — £.£ (1 — A, t) on the function (A, t). 
Combination of this relation with Eq. (|45|l then leads to 



£^{\,t) = £^{l-X,t) 



(46) 



for the equilibrium initial distribution /(yo, ^o) = feq{yo), 
as a form discussed in Ref. (25|. Equation is equiv- 
alent to the relation 



P w (W,t) 
P w (-W,t) 



exp(FT"). 



(47) 
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for the work distribution P w ( W, t), w hich is known as the 
transient fluctuation theorem |4Ctl53ll54| . [See Appendix 
|B]for a derivation of Eq. l(17fr from Eq. 

As shown in Eq. (|47|l . the transient fluctuation theo- 
rem is satisfied for any time being an identity [55j, but 
it requires that the system is in the equilibrium state at 
the initial time to. Therefore, one may ask what happens 
to the fluctuation theorem if we choose a noncquilibrium 
steady state, or any other state, as the initial condition. 
In the next subsection IIV CI we calculate the work distri- 
bution function P w (W,t) explicitly by carrying out the 
functional integral on the right-hand side of Eq. I|41|) via 
Eq. (|42(l . in order to answer this question. 



C. Functional integral calculation of the work 
distribution function 

To calculate the work distribution function P W (W, t), 
we note first that the function Sw\x,t), connected to 
P w (W,t) by Eq. (|4"5|l . can be rewritten as 



£i v \\, t)= J dy t J dy T{y u Vo; \)f{yo, to) (48) 
by Eqs. O and JSJl. Here, T{y t , y ; A) is defined by 



rvt 

Vy s exp 

' ya 



ds 



In 



(49) 



Equation (|49|l may be regarded as a constrained 
transition probability for the modified Lagrangian 
L^(y s ,y s ) - XW^ v \y s ) :56j. Here, the w-dependence of 
the function .F(yt,yo;A) has been suppressed, as it is in 
the rest of the paper. 

To calculate the function T(yt, yol A), we introduce the 
solution y* t of the modified Euler-Lagrange equation for 
the modified Lagrangian L^(y s> y s ) — XW^ (y s ), namely 

d dL^(~y* s ,y*s) dLM(~y%,y*s) | x ^ dW^(y* s ) =Q 



ds 



dy* 



dy* 



dy* 



(50) 



under the conditions y* = y t and (y* =)y\ = y . By 
solving Eq. (|50|l we obtain 



y% = -(l-2X)vT + A«X 2X)v) (yuyo)exp 
+ A i-t '(y ,yt)exp 



(51) 



where A[ v _} tg (y t ,y ) is defined by 



A< i-t (yt,yo) 



(y t + Vt) - (y + vr)b t 



1-6? 



(52) 

[See Appendix El for a derivation of Eq. (f5l)l .] The path 
{y*s}s£[t ,t] becomes the most probable path {y*} s e[t ,t] 
in the case of A = in which Eq. (|50|l is equivalent to 
Eq. (jSU). 

Using the solution y* s of the modified Euler-Lagrange 
equation 151|) . we obtain 



F{yt,yo-A) 



P ta ds[L^{~y*s,y's)-\f3W^{yV, 



\ I Vz s e 

'z 



(53) 



for the function J-(yt,yo', A), where z s is introduced as 

z s = y s -y*s, (54) 

namely the deviation of y s from y* s , satisfying the bound- 
ary conditions 



z t = z = 



(55) 



because y*o = yo and y% — yt, where z s = dz s /ds and 
z = z to . [See Appendix O for a derivation of Eq. .] 
For the functional integral for z s on the right-hand side 
of Eq. Q53J1 we obtain 



T>z s exp 



ds L^{z.,z„) 



1 



(56) 



noting that the Lagrangian (z s , z s ) on the left-hand 
side of Eq. i|56[l is for the case of v = 0. [See Appendix O 
for a derivation of Eq. I|5t)|) .] Inserting Eqs. (|51|l and l|56l) 
into Eq. I|53|) . the function J-(y t ,y to ; A) is represented as 



w 1 j [(V + VT ) - (Vo + vT)b t f 
F(y, y ; A) = exp ( — — h Xa(3v (y + y Q 



y/AnDTt { 4DT t " a " 1 + b t 

-A(l - X)af3v 2 (t - t - 2t \jj^) } (57) 
Using Eq. (|48J) and (|57|) and carrying out the integration over y we obtain 

£^(X,t) = e -Ml-A)a/S«n, f dyQ ^ y ^ t ^ e Xa^[y -^{l-h)]{l-h) (5g) 
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where Q t is defined by 



fi t = v < t - t 



1 + 6, 



(59) 



Equation l|58fl gives an explicit expression of the function £w\x,t) for any initial distribution f(yo,to) 
Inserting Eq. (|58|l into Eq. (|43|l . we obtain 



P w (W,t) 



1 



dyo /(yo,to)exp< - 



{W - apv [Qt - (1 - b t ) [yp - f (1 - b t )]]f 
4a(3vn t 



(60) 



as a concrete form of the work distribution P w (W, t) satis- 
fied by any initial distribution f(yo,to). From Eq. (|60|l . 
the asymptotic form of the work distribution function 
P w (W,t) is given by 



P w (W,t) 



t — > + 00 



exp 



(W - a(3v 2 t) 
ial3v 2 t 



(61) 



where we used the asymptotic relation il t t_> ~°° vt by Eq. 
(|59|l . and the normalization condition J dyo f(yo, to) = 1. 
It follows immediately from Eq. (|61|l that 



km y«) 



exp(VF). 



(62) 



Therefore, the work fluctuation theorem is satisfied 
for any initial condition (including the noncquilibrium 
steady state initial distribution) in the very long time 
limit. 



V. FLUCTUATION THEOREM FOR FRICTION 



In Sec. IIVI we emphasized a close relation between the 
nonequilibrium detailed balance relation like Eq. i|39|) 
and the work fluctuation theorem (|62|) . To show the use- 
fulness of such a relation we discuss in this section an- 
other type of nonequilibrium detailed balance relation, 
and show that it leads to another fluctuation theorem 
related to the energy loss by friction. 

We consider the rate of energy loss caused by the fric- 
tion force —ay s in the comoving frame. It is given by 

(v) 

—ay s v, so the total energy loss lZ t by friction in the 
time interval [to , t] is 



n [ :\y u yo) 



ds (-ay s ) v = -av(y t - y ) (63) 



using yo = yt - It may be noted that the energy loss 
TZ[ (y t , yo) by friction is determined by the particle po- 
sitions at the times to and t only, different from the work 
wj. v \{y s }), which is determined by the particle positions 
at all times s S [io,i]. 



Our starting point to discuss the fluctuation theorem 
for friction is the relation 

= fe g (yt)e J: ° dsLM{ ~ ih ' Va) (64) 

derived straight-forwardly from Eqs. i|l(J|) . (|14fl and l|63|l . 

It must be noted that there is a difference between Eq. 
(|64|l and Eq. (|39|l in the change (or no change) of sign of 
the dragging velocity v in their time-reversed movement 
on their right-hand sides. This difference leads to differ- 
ent fluctuation theorems as shown later in this section. 
Noting this difference, Eq. (|64|l can be interpreted as 
that the energy loss 1Z\ (yt, Ho) by friction is required to 
move the particle from yo to yt via the path {y s }se[t ,t] 
and to return it back from y t to yo via its reversed path 
without changing the dragging velocity v. Using Eqs. © 
and H64fl we obtain 



F 



fe q (yo) = F 



feq(Vt), 



(65) 



where we used F(^\*) = fy*Vy s exp[ / t * ds 

L^(-y B ,y s )], as shown by Eqs. jXS} and jXj} Hi- 
Equation l|65l) reduces to the equilibrium detailed bal- 
ance (|4"U|) in the case of v = because of lzf \yt,yo) = 
0. Therefore, Eq. I|64|) is another kind of generaliza- 
tion of the equilibrium detailed balance condition to the 
nonequilibrium steady state, like Eq. (J25J). 

We introduce the distribution function P r (R, t) of the 
dimensionless energy loss R by friction in the time- 
interval [to, t] as 



P r (R,t) = (SIR - 0n { t v) (y t ,y o ) 



(66) 



Like for the work distribution function, we represent the 
distribution function of energy loss by friction in the form 



1 f +co 

P r (R, t) = — dX e lXR £ r (i\, t) 

27T 7-oo 



(67) 
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where the Fourier transformation £ r (iX,t) is given by 



Sr(X,t) 



(68) 



dyt J dy F 

xf(yo,t ) 



Vi 



llo 



,-\01Z ( t v >(y t ,yo) 



(69) 



with Eqs. © and l|42|l. Here, the w-dependence of 
the function £ r (X,t) for friction, as well as a similar £- 
function for heat introduced later, has been suppressed. 
It follows from Eqs. {S>J}, ^ and TZ ( t v) (y ,y t ) = 
-TZ{ v \yuy ) that 



£ r (l-X,t) =£ r (X,t) 



(70) 



if /(yo^o) = feq(yo)- Or equivalently, for the distribu- 
tion function P r (R, t) of the dimensionless energy loss by 
friction, using Eqs. (|BTjl and (|70l) we obtain 



P r (R,t) 
P r {-R,t) 



= cxp(i?) 



(71) 



for the equilibrium initial condition. Equation (|71(l is the 
transient fluctuation theorem for friction and is satisfied 
for any time t. 

If one is interested in the derivation of a fluctuation 
theorem for more general initial states than the equilib- 
rium initial state, we can proceed as follows. Using Eqs. 
@, E21 and (nnj) we obtain 



Pr(R,t) = I dy t I dy f(yo,t ) s(r - ^\y t , y j) F 



^/Aiia(3v 2 T t 



dyo /(yo,io)exp • 



[R-af3v(yo+vT)(l-b t )} 2 
4a/3v 2 T t 



(72) 



for any initial distribution f{yo,to), where we used 

Eqs. 03, m and S(R - (371^ (y u y )) = S(y t - y + 
R/{af3v))/{ap\v\). 

To get more concrete results, in the remaining part of 
this section we concentrate on the initial distribution 



f(yO,to) = feq(yO+VT(, 



(73) 



for a constant parameter 0, giving the equilibrium initial 
distribution for = and the non-equilibrium steady 
state initial distribution for <fi — 1. Inserting Eq. I|73|l 
into Eq. lf?2"|l the distribution P r (R, t) is given by 



Pr(R,t) 



1 



y/4na(3v 2 T (1 - b t ) 

{ \R~a(3v 2 T{\ 



x exp ■ 



4af3v 2 T(l - b t ) 



using Eq. 03J- ^ follows from Eq. {71} that 



Pr(R,t) 

Pr(~R,t) 



= exp[{l - </>)R], 



(74) 



(75) 



which does not have the form of a fluctuation theorem 
for <p ^ 0. In other words, the distribution function of 
energy loss by friction satisfies the transient fluctuation 
theorem for = 0, but not the steady state fluctuation 
theorem using the steady state initial condition (|73fl for 
= 1. Actually, for the initial condition of a nonequilib- 
rium steady state, i.e. if <p = 1, its distribution P r (R, t) is 



Gaussian from Eq. (|74|l with its peak at R = 0, therefore 
P r (—R,t) = P r (R,t) then at any time. 



VI. EXTENDED FLUCTUATION THEOREM 
FOR HEAT 

As the next topic of this paper, we consider the distri- 
bution function of heat, which was defined in Sec. IIII Al 
but now we calculate it by carrying out a functional in- 
tegral, and also discuss a new simple derivation of its 
fluctuation theorem briefly in the long time limit. 

The distribution function of the dimensionless heat Q 
corresponding to PQt ({ys}) using Eq. (|19|l is given by 



P q {Q,t) = {5{Q-{3Q ( t\{y s }) 



(76) 



The heat distribution function P q (Q, t) can be calculated 
like in the distribution function of work or energy loss by 
friction, namely by representing it as 



P q (Q,t) 



2- 



dX e lXQ £ q (iX,t) 



where £ q {X,t) is given by 



£ q (X,t) 



(77) 



(78) 



= / dy t J dy e xpu ^T(y u y Q ;X)e- XpU[yo) 
xf(yo,t ) (79) 
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where we used Eqs. (EU, (EH, EH and g^J to derive 
Eq. i|79|) from Eq. (J7SJ- It may be meaningful to notice 
that from Eqs. I0H1) an d HU the function £ q (\,t) for 
heat is different from the function £w (A, t) for work by 



the factor exp{A/3[C/(y t ) — £/(yo)]} only. Inserting Eq. 
(|5?|) into Eq. one obtains 



£,(A,t) = 



1 



: exp 



A (1-6?) 

dyo /(yo,io)exp 



t-*n 



A(l - A)a/3w 2 

/3kA(1-A)(1 



2t- 



l + &t 



2 1-A(1 



6?) 



2/0 



(80) 



for any initial distribution f(yo,to). 

The calculation of the heat distribution function 
P q (Q, t) from its Fourier transformation like £ q (iX, t) has 
already done in Ref. in detail, for the initial condition 
of the equilibrium and nonequilibrium steady state, and 
led to the extended fluctuation theorem for heat EH • 
We do not repeat their calculations and argument in this 
paper. Instead, in the remaining of this section we dis- 
cuss the heat distribution function and its fluctuation 
theorem by a less rigorous but much simpler argument 
than in Ref. [3(| . This discussion is restricted to the case 
of the long time limit, in which time-correlations of some 
quantities may be neglected. This allows to simplify con- 
siderably the derivation of the relevant distribution func- 
tions. The heat fluctuation theorem is also discussed in 

Refs. mmi^. 

We start our argument by assuming that the particle 
energy is canonical-like distributed due to the presence 
of the fluid surrounding a Brownian particle [3f| , so that 
the distribution P e {E) of the dimensionless energy E, i.e. 
the (potential) energy times the inverse temperature (3, 
is given by 



P e (E)^9(E) exp(-E), 



(81) 



where 0(x) is the Heaviside function taking the value 1 
for x > and for x < 0, and 0(E) in Eq. l(HT)l guar- 
antees that the energy E is positive. [Note that on the 
right-hand side of Eq. i|81|) the normalization condition 
J dEP e (E) = 1 is still satisfied.] Now, we consider the 
distribution function P Ae (AE, t) of the dimensionless en- 
ergy difference AE(— E t — Eq) at the initial time to and 
the final time t, which is given by 

P Ae (AE,t) J dE Q J dE t P e (E )P e (E t ) 

xS(E t -E -AE), (82) 

namely J dE P e (E )P e (E +AE), in the long-time limit. 
Here, we have assumed that the energy Eq at the initial 
time to and the energy E t at the final time t are un- 
corrected in the long time limit t — > +oo, so that the 



distribution function of the energies E and E t is given 
by a multiplication of P c (Eq) (the initial energy probabil- 
ity distribution) and P e (E t ) (the final energy probability 
distribution). The distribution function P Ae (AE,t) is 
given by the integral of such a distribution function of 
the energies E and E t over all possible values of E and 
E t under the constraint AE = E t — Eq, therefore by Eq. 
(|S2|l . Inserting Eq. JSTJ into Eq. (JS2J we obtain 



P Ae (AE,t) '-^iexpHAiSl), 



(83) 



meaning that the distribution function P Ae (AE, t) of the 
energy difference AE decays exponentially. [Note again 
that the right-hand side of l|83|) satisfies the normalization 
condition J dAEP Ae jAE,t) = 1.] The argument leading 
to Eq. dS2l is also in Ref. |35| . 

On the other hand, we have already calculated the dis- 
tribution function P w (W,t) of work W in Sec. IIV CI and 
from Eq. (|61|l we derive 



P w (W,t) 



t— >+oo 



exp 



(w-w t y 



(84) 



for any initial distribution. Here, Wt is the average of 
the (dimensionless) work W for the distribution P W (W, t) 

and given by Wt a(3v 2 t from Eq. I|tjl|) m the long 

time limit. 

By Eq. (JSTJ, the heat Q is given by Q = W - AE 
using the work W and energy difference AE, and its 
distribution function P q (Q,t) should be represented as 

P q (Q,t) J dW J dAE P w (W,t)P Ae (AE,t) 

xS(W - AE - Q), (85) 

namely J dW P w (W,t)P Ae (W - Q,t), in the long time 
limit. Here, we used a similar argument as in Eq. 182|) 
in order to justify Eq. 1)85(1 . namely, Eq. (|85|l is the 
integral of the multiplication of the work distribution 
Pw(W,t) and the energy-difference distribution function 



11 



PAe(AE,t) over all possible values of W and AE under 
the restriction Q — W — AE for a given AE. Non- 
correlation of the work and the energy difference in the 
long time limit, which is assumed in Eq. Ij85[l. may be 
justified by the fact that the work depends on the par- 
ticle position over the entire time interval [io,t] by Eqs. 
O and H20|) (in which the effects at the times to and t 
are negligible in the long time limit) while the energy dif- 
ference depends exclusively on the particle positions at 
the times to and t only. Inserting Eq. 1(83(1 and 184|) into 
Eq. (|8*5|) we obtain 



P q (Q,t) *" 



-Q+2^ erfc 



+e Q erfc 




with the complimentary error function erfc(cc) defined by 
erfc(a;) = (2/y/n) J °° dz exp(— z 2 ), satisfying the in- 
equality < erfc(:r) < 2. One may notice that the 
average work W t is equal to the average heat in the 
case of the nonequilibrium steady state initial condition 
/(yoj*o) = /ss(2/o)) because of the energy conservation 
law 1(211) and the fact that average of the internal energy 
difference 112211 is zero in this case. Equation ((86(1 gives 
the asymptotic form of the heat distribution function. 
The exponential factors exp(±Q) in Eq. ((86(1 dominate 
the tails of the heat distribution function P g (Q,t) j3(|. 

Now, we introduce the fluctuation functions G w (W,t) 
and G q (Q,t) defined by 



G w {W,t) 
G q (Q,t) 



± ln _PAW,t) 



w t p w {-w,ty 

J_ ^ Pq{Q,t) 

W t n P q (-Q,t) 



(87) 
(88) 



for the work distribution function P W (W, t) and the heat 
distribution function P q (Q,t). By Eq. 184(1 the func- 
tion G w (W,t) is given simply by G w (W,t) W/W t 
in the long time limit, characterizing the work fluctu- 
ation theorem in a proper way to compare it with the 
heat fluctuation theorem characterized by the function 
G q (Q,t). In Fig. 0thc functions G w (W,t) (broken line) 
and G q (Q, t) (solid line) arc plotted as functions of X/Wt 
(X = W or Q) using Eqs. (HI} and (JBEJ in the case of 
Wt = 70. In this figure we plotted only in the positive 
region of W and Q, because their values in the negative 
region is simply given by G w {— W, t) = — G W (W, t) and 
G q (-Q,t) = -G q (Q,t). It is clear from Fig. EI that the 
values of the functions G w (X, t) and G q {X, t) will coin- 
cide with each other for small W and Q for W t — > +oo, 
i.e. t — > +oo, meaning that the heat fluctuation theo- 
rem coincides with the work fluctuation theorem in this 
region. The difference between the heat and work fluc- 
tuation theorems appears in the large values of the ar- 
gument, where the function G W (W, t) remains W/Wt, 



2.5 



1.5 



0.5 





AT 


G q (X,t) 





x/w t 



FIG. 2: Comparison of the work fluctuation theorem and the 
heat fluctuation theorem by plotting the function G w (X,t) 
for the work distribution and the function G q (X,t) for the 
heat distribution as functions of a scaled X/W t in the long 
time limit t — » +oo. Here, we used the asymptotic forms 
184H and 1861 of the work distribution function and the heat 
distribution function, respectively, in the case of Wt = 70. In 
the small X region (0 < X/Wt < 1), the values of the two 
functions G m (X,t) and G q (X,t) appear to be consistent with 
G w (X,t) = G q (X,t), while G w (Xjt) is X/W t and G q (X,t) is 
2 in the large X region (3 < X/Wt < +oo) in the long time 
limit. 



while the function G q (Q,t) takes the constant value 2 
for Q/Wt > 3 in the long time limit. For further details, 
we refer to Ref. |3jj. 



VII. INERTIAL EFFECTS 

So far, we have concentrated our discussions to the 
over-damped case and have neglected inertial effects. A 
generalization of our discussions to the ones including 
the inertia is almost straightforward. One of the fea- 
tures caused by introducing inertia is a kinetic term in 
the equilibrium and nonequilibrium steady state distri- 
bution functions. This kinetic term depends on the frame 
one uses, namely the comoving frame or the laboratory 
frame, respectively. The inertial force, like d'Alembert's 
force, also appears as an inertial effect. In this section 
we discuss briefly these effects beyond the over-damped 
case. 

The Langevin equation including inertia is expressed 
as Eq. Q in the laboratory frame. Like in the over- 
damped case, we can convert Eq. Q for the laboratory 
frame to 



1 dt 2 



-a^ -n{y t + vt) + Q (89) 



for the comoving frame by Eq. (J5J. Equation l|89|) 
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reduces to Eq. (JHJ for the over-damped case when 
md 2 y t /dt 2 = 0. 

We introduce a canonical-like distribution function as 

fW(y, y) ee 3W- 1 exp [-0H (y + to), y)] (90) 

where y is the time-derivative of y and 7i (y, y) is defined 
by 



H(y,y)=my 2 /2 + Ky 2 /2, 



(91) 



and 3^ is the normalization constant for the distribu- 
tion function fiq\y, y)- It is important to note that the 
particle velocity depends on the frame, and is given by y 
for the comoving frame and by x{= y + v) for the labo- 
ratory frame. For that reason, the canonical distribution 
function feq\y,y) including the kinetic energy depends 
on the frame, so that feq\y,y) for ■& = refers to the 
comoving frame and /j<^ (y, y) for 1? = 1 refers to the 
laboratory frame. 

By a way similar to the over-damped case, the func- 
tional probability density for path {y s } s e[to,t] ^ s gi yen by 
exp[J to ds (y s ,y S7 y s )} with the Lagrangian function 



L (v) (y s ,ys,y s ) = -7^ 



, n 1 Vs + -y s + v + —y t 

AD \ t a 



(92) 



using y s = d 2 y s /ds 2 . The Lagrangian function (|§2*|) be- 
comes the Lagrangian function (|10fl in the over-damped 
case, where my s — 0. Using Eqs. (|90|1 and H92|l we obtain 

= /W(d*,».)^* £C± ' ) «--*-*i (93) 



' eg 

where y = 2/t , and A±{y s ,y s ,y s ;d) is a modified "force" 
defined by 

A /•• ,x 1T1 . 1±1 

A±{y s ,y s , y s ;#) = -ny s — ay s — ^~ 

'1T1 



1? . (94) 



Equation Ij93(l may be regarded as a nonequilibrium de- 
tailed balance relation for the case of a potential force, 
friction and inertia. [See Appendix [D] for a derivation 
of Eq. Ipfy.] Moreover, the signs ± in Eq. iffify cor- 
respond to the case of work (—1), discussed in IIVI and 
that of energy loss by friction (+1), respectively, dis- 
cussed in Sec. E] and are due to the ±v signs of the 
Lagrangian L^ ±v \y s ,—y s ,y s ) on the right-hand side of 
Eq. l|9"5|) . It should be noted that the first, second and 
third terms on the right-hand side of Eq. (|94|l are re- 
garded as the harmonic force, the friction force, and the 
inertial (d'Alembert-like) force, respectively. 

Now, we introduce the dimensionless modified "work" 
rate j3A±(j),y,y; l &)v and its distribution function 



V ( ± ] {W,t) as 

v¥\w,t) = ^s(w-0 jf ds A ± (y,y,y;$)v^ (95) 

where ((• • •). is the functional average in the inertia case, 
like the one given by Eq. I|42|l . Here, we remark that 
W in Eq. (JSSJ differs from the work wj: v \{ys}) defined 
by Eq. (|20|l . In a way similar to derive Eqs. I|47|l and 
(I71|l in the over-damped case, it follows that the distribu- 
tion function V±^ (W, t) satisfies the transient fluctuation 
theorem 



= exp(W) 



(96) 



under the condition that the initial distribution at time 
to is given by the feq\y,y)- Here, the distribution 
vf ] {W,t) is defined by 



= {{5[W-P dsA ± (y,y,y;(-l) — $)v 

Jt j 11 t 



and is simply given by 

f> ( +\w,t) = pf\w,t), 



(97) 

(98) 
(99) 



in these special cases, and in order to de- 
rive Eq. (ffifl) we also used the rela- 
tions L (v \y Sl y s ,y s ) = L^(-y s ,-y s ,-y s ), 
A±(y s ,y s ,y s ;tf) = -A±(-y s , -y S) -y,;t?) and 

A±(y s ,2/ S ,y s ;tf)v = -A±(y s ,-y s ,y s ; (-l) 1 ^ 1 d){±v). 

(100) 

It may be noted that the two terms —ay and my 
for the force A + (y s ,y s ,y s ; 1) have different time-reversal 
properties than the other forces A + (j/ s , y s , y s ; 0) and 
A+(y s ,y s ,j/ s ;i?). 

From Eq. ® we derived four different fluctuation 
theorems corresponding to the cases (•&, ±v) = (0, — v), 
(1,— v), (0,v), and (l,u), where ±v is the velocity ap- 
pearing in the Lagrangian function '(jj s , —y s ,y s ) on 
the right-hand side of the nonequilibrium detailed bal- 
ance relation We summarize these four fluctua- 
tion theorems in Table HJ In the last line of this table, 
appearance of the function V^\—W,t) for the case of 
(z?,±u) = (l,v) is due to the different behavior with 
respect to time-reversal of the two terms —ay and my 
composing the modified force A + (y s , y 8 , y s ; 1), while in 
all the other cases in Table[l]the modified forces have the 
unique behavior under time-reversal. 
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TABLE I: Four kinds of fluctuation theorems corresponding to four forces in the case including inertial effects. Here, # = 
(i? = 1) is for the case of the comoving frame (the laboratory frame), and ±v is the velocity appearing in the Lagrangian 
function L' ±u '(j/ S , — y 3 , y s ) on the right-hand side of the nonequilibrium detailed balance relation 19311 . 



Frame (#) 


±u 


Force A 


Fluctuation Theorem 


Comoving (0) 
Comoving (0) 
Laboratory (1) 
Laboratory (1) 


— V 
+v 
—v 
+v 


A- (y, y, y; 0) = -ny - my 

A-+(y,y,y,o) = -ay 
^-(y,y,y; l) = 

A+(i/, y,y,l) = -ay + my 


r ( ° } (w,t) 

7Tj\ = exp(W) 

^+ 0) (W,t) AAA 

— tJ, = exp(W) 

P^fW-f) AAA 

tt\ = exp(W) 

P^fW,!) aa A 

^rfi = exp(W) 



VIII. CONCLUSIONS AND REMARKS 

In this paper we discussed a generalization of Onsager- 
Machlup's fluctuation theory to nonequilibrium steady 
states and fluctuation theorems based on nonequilibrium 
detailed balance relations. To that end, we used a model 
which consists of a Brownian particle confined by a har- 
monic potential which is dragged with a constant velocity 
through a heat reservoir. This model is described by a 
Langevin equation, which is a simple and exactly-solvable 
nonequilibrium steady state model. Our basic analytical 
approach is a functional integral technique, which was 
used in Onsager and Machlup's original work and is ef- 
fective to discuss fluctuation theorems treating quantities 
expressed as functionals, for example, work and heat. 

First, we gave an expression of the transition proba- 
bility in terms of a Lagrangian function which can be 
written as a sum of an entropy production rate and two 
dissipation functions. There is a difference, though with 
the similar result of Onsager and Machlup's original pa- 
pers 0,0], in that now the entropy production rate and 
one of the two dissipation functions - and consequently 
also the Lagrangian function - depend on the dragging 
velocity v leading to nonequilibrium steady state effects. 
From this property of the Lagrangian function, we con- 
structed a nonequilibrium steady state thermodynamics 
by obtaining the second law of thermodynamics and the 
energy conservation law which involves fluctuating heat, 
work and an internal potential energy difference. We also 
discussed Onsager 's principle of minimum energy dissi- 
pation and the most probable path approximating the 
transition probability of the particle position. This ap- 
proach is different from another attempt for an Ons ager - 
Machlup theory for nonequilibrium steady states 
where a nonlinear diffusion equation is applied to models 
like an exclusion model and a boundary driven zero range 
model. Instead, we use a stochastic model described 



by a Langevin equation, so that our results automat- 
ically include those of Onsager and Machlup's original 
works by taking a specific equilibrium value, v = 0, for 
the nonequilibrium parameter v, and relax Onsager and 
Machlup's variable a and a in Refs. 0,^3 to our vari- 
ables x and x, respectively. 

Second, we derived nonequilibrium detailed balance re- 
lations from the Lagrangian function to obtain not only 
the well-known fluctuation theorem for work but also an- 
other fluctuation theorem for energy loss by friction. We 
also indicated the derivation of the extended fluctuation 
theorem for heat by carrying out explicitly the relevant 
functional integral and then using Refs. 35, 36]. In addi- 
tion, we gave a simple argument for the heat fluctuation 
theorem in the long time limit. Finally, we discussed 
briefly the effects of inertia, and obtained four different 
fluctuation theorems related to a potential force, a fric- 
tion force and d'Alembert-like (or inertial) force for the 
comoving frame or the laboratory frame. 

In the remaining of this section, we give remarks for 
the contents in the main text of this paper. 

1) In this paper, we have emphasized a close connec- 
tion between nonequilibrium detailed balance relations 
and fluctuation theorems, using a functional integral ap- 
proach. It may be noted that in some of past works con- 
cepts of detailed balances have been mentioned for formal 
derivations of fluctuation theorems in various different 
contexts, implicitly or explicitly [H ESS El E3. 
However, we should keep in mind that a generalization of 
the equilibrium detailed balance to nonequilibrium states 
is not unique, as shown in this paper [cf. Eq. I|39|l and 
l|64p] . As a remark related to this point, we should notice 
that even if the equilibrium detailed balance condition is 
violated, but another detailed balance condition for the 
nonequilibrium steady state still holds, namely, using the 
nonequilibrium steady state distribution / ss (y) we obtain 
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for the over-damped case: 

e /4 d s ^\V^) fss{ y Q) = fM Jl ds L^\-y s ,y s )^ (1Q1) 

by Eqs. ifTflj). (JT2J) and , or equivalently 
PC* C )fss(yo) = F{ va |f )f ss (y t ). Here, it is essential to 

t to t to 

note that on the right-hand side of Eq. (|101f> we do not 
change the sign of the dragging velocity v although we 
change the sign of the particle velocity y s in the comov- 
ing frame. We emphasize that here, there is no additional 
multiplying factors like exp[-/3W t (t '' ) ({?/s})] as in Eq. 
or exp[— l3Tz[ v \y t ,yo)} as in Eq. (|fj4l . As a consequence 
we have been unable to derive fluctuation theorems from 
Eq. (|101fl . Since we chose the equilibrium state as the 
reference state for the detailed balance in this paper, our 
interest was mainly the work to maintain the system in 
a noncquilibrium steady state, i.e. the work necessary 
to keep the system from going to the equilibrium state. 
In this sense, we note that the reference state is arbi- 
trary, for example, if we are interested in the work to 
go from one nonequilibrium state to another nonequilib- 
rium state. In general, the modification of the detailed 
balance relation based on an arbitrary reference distribu- 
tion function f r ef(y) can be expressed as 

e -w( { ^) e /;^W) /re/(yo) 

= f ref (y t )e^ dsL ^-y^ (102) 
where Y t ({y s }) is the functional defined by 

Y t ({y s })^Q^({y s })+l3-Hn^A. (103) 

Jrefiyt) 

Choosing f re f(y) = f eq (y), Eq. (|102|l leads to Eq. 
We can also get a generalization of Eq. 164fl for an ar- 
bitrary reference distribution function / r , f (y) ■ An anal- 
ogous quantity to Y t ({y s }) is in Ref. |53j for a ther- 
mostated system with deterministic dynamics. 
2) From Eq. 1(101(1 we derive 



ds LW(v„y a ) + S„(yo)/k B 

dsL^(-y s ,y s )+S ss (y t )/k B (104) 



to 

where S ss (y) is defin ed by S ss (y) = k B ^f ss (y). An 
identity like Eq. (II 04|) is called an Onsager-Machlup sym- 
metry [13, Il3, |20j, and is used to discuss macroscopic 
properties of nonequilibrium steady states. Using Eq. 
(|104fl we can also obtain an expression like 



exp 



fl da L^(y s ,y s ) 



withQ ss (t,t ) =T[S ss (y t )-S ss (y )]. On the other hand, 
it can be shown from Eqs. 1(14(1 . (|21|l and ((39(1 [or from 
Eq. (jTTJ^jl ] that 



exp 


'St ds L^(y s ,y s ) 




exp 


SldsL(-v)(-y s ,y s ) 



exp 



/3ei" ) ({».})! (106) 



exp 



St Q dsLiv){-y s ,y s ) 



exp 



0Q„(t,to) (105) 



using the heat Q { t v) {{y s }) of Eq. $T§fr. Note that Eq. 
(|106fl is consistent with the heat Ql v \{y s }) appearing 
in our energy conservation law 1)21(1. in contrast to Eq. 
(|105fl in which the quantity Q ss (t, to) does not have such 
a correspondence with the heat. Thus we will restrict 
ourselves in the following to Eq. (|106fl . As we discussed 
in Sec. [n] the term exp[J to ds L^ v \y s ,y s )] appearing in 
the numerator on the left-hand side of Eq. 1(106(1 is the 
probability functional of the forward path {y s } S £[t ,t] ■ On 
the other hand, the denominator on the left-hand side 
of Eq. I(106|l is the probability functional of the corre- 
sponding time-reversed path with the dragging velocity 
—v. Therefore, Eq. ((106(1 implies that the logarithm of 
the ratio of such forward and backward probability func- 
tionals is given by the heat multiplied by the inverse tem- 
perature. In this sense it is tempting to claim Eq. I|10{j|) 
as a relation leading to a fluctuation theorem ;62, 63J,|64|. 
However, it is important to distinguish Eq. I|106|) from 
the fluctuation theorems discussed in the main text of 
this paper. First of all, although it is related to the heat, 
Eq. i|106D has a form rather close to a relation leading to 
the conventional fluctuation theorems like Eqs. H47|) and 
(|71|l . which are different from the extended form for the 
heat fluctuation theorem discussed in Sec. I VII Similarly, 
although one may regard Eq. (|106f) as a nonequilibrium 
detailed balance relation for heat, a derivation of the ex- 
tended fluctuation theorem for heat from a nonequilib- 
rium detailed balance relation remains an open problem. 
We should also notice that no initial condition depen- 
dence appears in Eq. (|106)l . so that we cannot discuss 
directly, for example, a difference between the transient 
fluctuation theorem and the steady state fluctuation the- 
orem for them from Eq. 1)106(1 . 

3) Although the nonequilibrium detailed balance rela- 
tions, like Eq. (|3l)|) . (|()4*)l or 1(102(1 . play an essential role 
to derive the fluctuation theorem, it is important to note 
that some properties of the fluctuation theorem cannot 
be discussed by it. Basically, the nonequilibrium detailed 
balance relation can lead directly to the so-called tran- 
sient fluctuation theorems, which are identically satisfied 
for any time |55l | , but this relation does not say what hap- 
pens to fluctuation theorems if we change the initial con- 
dition (like the equilibrium distribution) to another (like 
the nonequilibrium steady state discussed in the steady 
state fluctuation theorem). The transient fluctuation 
theorem can be different from the steady state fluctu- 
ation theorem for some quantities, even in the long time 
limit. As an example for such a difference, we showed 
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in this paper that the energy loss by friction satisfies the 
transient fluctuation theorem but does not satisfy the 
steady state fluctuation theorem. 

We have discussed an initial condition dependence of 
fluctuation theorems by carrying out functional integrals 
to obtain distribution functions explicitly, and showed 
that the work distribution function has an asymptotic 
form satisfying the work fluctuation theorem, indepen- 
dent of the initial distribution, while the friction-loss dis- 
tribution function depends on the initial condition even 
in the long time limit. This difference between the work 
and the friction-loss might come from the fact that the 
work is given by a time-integral of the particle position 
so that its contribution near the initial time can be ne- 
glected in the long time limit, while the energy loss by 
friction is given by the particle position at the initial and 
final times only. A systematic way to investigate whether 
a fluctuation theorem is satisfied for any initial condition 
without calculating a distribution function, remains an 
open problem 65]. 

4) Finally we note that the analogy of the Brown- 
ian particle case, discussed here, and the electric circuit 
case should persist not only in the over-damped case (as 
shown in |4lJ) but also in the case including inertia. In 
that case, one has to add the self-induction Lq of the elec- 
tric circuit, as the corresponding quantity of the mass m 
of the Brownian particle. This will add the correspon- 
dence of m and L to Table I in Ref. 0. Then, the 
fluctuation theorems in Table U in Sec. IVIII of this paper 
can, by using the extended analogy described above, also 
be used for electric circuits, and might be experimentally 
accessible (cf. 
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APPENDIX A: TRANSITION PROBABILITY 
USING A FUNCTIONAL INTEGRAL 
TECHNIQUE 

In this Appendix, we outline a derivation of the tran- 
sition probability © for the stochastic process described 
by the Langevin equation ©. 

First, we translate the Langevin equation Jfjjl into the 
corresponding Fokker-Planck equation. It can be done 
using the Kramers-Moyal expansion technique [tH l45j | , 
and we obtain the Fokker-Planck equation 



df(y,t) 

at 



£f(y,t) 



(Al) 



for the distribution function f(y,t) of the particle posi- 
tion y at time t. Here, C is the Fokker-Planck operator 
defined by 



t dfy + vr +D d 
dy \ t dy 



(A2) 
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with D = l/(a/3). 

The transition probability F{ t ^ At f t ) from y' at time 
t to y at time t + At is given by 



t+ At 



> CAt S(y y') 



l + CAt + 0(At 2 



. d y' + vt 
1 + At— — - — + DAt 



dy 



2tt 
1 

2^ 



dX 1 + At 



8{y- y') 

dy 2 
y' + vt d 



)s(y-y')+0{At 2 ) 



d\ exp 



t dy 
-DAtX 2 + iAt 



DAt-^)vs V [,M„ -„')} - Oi AZ- 
tZ -y' y' + vr^ 



At 



O (At 2 



1 

VinDAt 



exp 



i ( y ~ y' y' + vt 



AD \ At 



At 



0{At 2 ) 



(A3) 
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where we used yS (y — y') — y'S (y — y'). On the other hand, using the Chapman-Kolmogorov equation |4£ 
transition probability for a finite time interval t — to is expressed as 



the 



F 



lim 



dy N -i I dy N - 



dyi F 



Hi 



VN- 



F 



VN- 
tN- 



VN-2 
ijV-2 



F 



I/O 

to 



(A4) 



witht„ = to + nAtN, n = 1,2, ••• ,N, At N = (*-i )/iV, tion of Eq. i|T7j> from Eg. gBJ|. 
tpj = t. Inserting the expression 1A3I) for the transition 
probability in a short time interval At = Atw into Eq. 
(|A4|) we obtain Eq. © with the functional integral (|TT)l . 



APPENDIX B: FLUCTUATION THEOREM FOR 
WORK 

In this Appendix, we show the relation £w (X, t) = From Eq. (JSJ with the functional average JEJ we 

Sk~ v) (1 -A, t), therefore Eq. gZJ. We also give a deriva- derive 



£W(\,t) = / dy t I"' Vy s [ dy Q A ds ^"^/(l/O, to) e-W?Hiv.V 



tin 
Vt 



dy t ['Vyj dy f eq (y t ) A dsL ^~^ e W ( *W)^_ f(yaM e -^({«.}) 

./j/0 J Jeq(yo) 



lit 



= Idyol % ^^.."""''-^^/.fcle- 11 -^"''"^' (Bl) 
Jyo J 

'dy t f Vt Vy s [ dy X ds f eq (y ) e-W^t'^v.}) (B2) 

Jyo J 

4-")(l-A,t) (B3) 



where we used Eqs. Qg) and W t ( " J ({y s » = 

-Wt V \{ys}), and the assumption f(y ,t ) = feq(yo)- 
Here, in the transformation from Eq. I|B1(I to Eq. I|B2|) 
we changed the integral variables as y s — > yt+t -s (so 
that y s — > —y s , y t — > yo and y ^ y t ). Therefore, we ob- 
tain £^(A, t) = ^-t« (1 — ^»t), whose combination with 
Eq gSJ leads to Eq. lEmT) . 

Moreover, from Eqs. (|43l) and l|46|) we derive 

i r + °° 

P w {W,t) = — J dXe iXW £^(l-iX) 

i r + OO-i 

= 7T / dpe^-i^^M (B4) 

= pW ^j dpeW-vneWM (B5) 

= e w P U) (-W,t) (B6) 

with fj, = — A — i. Here, in the transformation from Eq. 
(|B4ll to Eq. (jB5j) we used the fact that noting Eq. jUjl 



the function £$ (ifJ,) exp[(l — appearing in Eq. 

(|B4(I does not have any pole in the complex region for 
Im{^} £ [0, 1] (here Im{^} is the imaginary part of /x). 
Using Eq. [fBl^) we obtain Eq. ll4"?|) . 



APPENDIX C: FUNCTIONAL INTEGRAL 
CALCULATION FOR THE WORK 
DISTRIBUTION 

In this Appendix, we give calculation details of Eqs. 
(EU, (J53J and |56). 
Inserting Eq. and lfTT)|l into Eq. > we obtain 

ri 2 y* _ y« + (1 - 2X)VT 

where we used the relations a — kt and D = l/(a/3). 
[Note that Eq. IClfl for y* is Eq. (|3*3^l for except for 
that Eq. (jcT) use (1 - 2X)v instead of v in Eq. l|53|).] 
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The solution of Eq. (jClfl is given by 

y* a + (1 - 2X)vt = Ai exp (-) + A 2 exp (--) . (C2) 

Here, and ^2 are constants determined by the condi- 
tions y* t = y t and y* (= y% ) = y , namely 



y Q + (1 - 2X)vt 
y t + (l- 2X)vt 



exp(^) exp(-&) 
exp (|) exp (-|) 



Solving Eq. I|C3(I for A\ and A2 we obtain 



A 2 



A x 



A«X 2X)v) (yt,yo)ex P (-±) 



A 



(C3) 



(C4) 



with the function A^} to (y t , yo) defined by Eq. (|52|l . Fur- 



ther, we note 



A -lt-t )(yt>yo) = A { t v J to (y ,y f )b t 



(C5) 



which can be shown from Eq. (52) • Using Eqs. ljC2j) . 
(|C4|I and l|C5|l we obtain Eq. (51}. 

Noting that the Lagrangian function L^(y S: y s ) de- 
fined by Eq. I|1U|) and the work rate W^ v \yt) given by 
Eq. (0) are the second order to yt and y s at most, we 
obtain 



ds 



= / ds 



L^(y* s + k a ,y* a + z s ) - X(3W(y% + z a ) 



ds {L^{y* s ,y* s )-X(3W(y*s) + 



^ v) (U,y*s)-^w(y*s) 



to 



dyt 



LW(~yt,y* s )-Xf3W(y*s) 



L^(~y* s ,y*s)-Xf3W(y*s) 



2 



dy* s 

LW(y* s ,y* s )-XflW(y*s) 



dy* s dy* s 
ds{L^\r s ,y* s )-XpW{Ts) 



dyt 2 

L^(~y* s ,y* s )-X/3W(y*s) 



dy% 



S 2 



to 



= / ds 

'to 



d dL^(it,V*s) dL^{%,y%) + dW{y* s ) 



ds 



dyt 



dy% 



dy* 



I (±2 2 A . 1 . 
— [ z s + -z s z s + —~z 

W \ T T 2 



L^(~y* a ,y* s ) - Xf3W(y*s) + L^(k a ,z a ) 

I 



(C6) 



using a partial integral and Eqs. (|10(l . (| 5 C)|> and (|54|l . zq = z t „ — from Eq. I|55|) we have 
Inserting Eq. l|C6jl into Eq. (gH) we obtain Eq. (53) • 



n=0 



y - 



+^fe+i(<^)zfe+i 



(C7) 



Noting t n = t + nAt N , n = 1, 2, • ■ • , N, At N = (t - 
to)/N, the initial time to, the final time tn = t, and for a constant ip and k = 1, 2, ■ • • , where A„((p) is defined 
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by 



(C8) 



We can prove Eq. (|C7|) for any integer k by mathematical 
induction, using the fact that the function A n (ip) given 
by Eq. (|C8(1 satisfies the recurrence formula 



A n +i(<p) 



A n (<p) 



(C9) 



A n (ip) + Lp 2 ' 

Using Eq. (|C7|) and z tN = z t — from Eq. f5K|) . we 



obtain 

JV-l 



n=0 



N-l 



A n {v) + v* Z *" +1 J 
(CIO) 



for a any constant and k = 1, 2, • • • . Using the func- 
tional integral (|1 1|) . the Lagrangian function (|10|l for 
v = 0, Eq. (|C10|I for 99 = <^jv = (Aijv/r) — 1, we obtain 



D^s exp 



lim 



to 



/ 1 



Hm f L 

\4TrDAtN 

lim [ 

n^+oo \4nDAtN 

x exp 



N/2 



N/2 



N/2 



1 



dzt„ , / <25 



JV-l / u ^W-2 



ditj exp 



iV-l 



n=0 



At 



N 



-i z t„ 



N-l 



dz tN _ 1 I dz tjv _ 2 ■ ■ ■ ( dz h exp - 1 E (</>A^«„ + Ztn+iY 

J j y n ra=0 

dz tl 



dz±„ , / <25 



4£>A< 



tjV-l / UZ tjV-2 

jV-1 
n=l 



Ai(<£>iv) + tf N 



Z t n +l 



N-l 

= Um 1 TT . 



lim 



V47rDAiAr y/A n {ip N ) +<p 2 N 
1 

=«= TT 



' Aj+i(¥>Jv) 



+00 ^AnDAt N 1^ y A„((^at) 



lim 



V AnDAt 



N- 



N 



lim ^ 2tt£>t 1 - 



2t7V 



1-1- 



t-*o 
tN 



2N 



-1/2 



y/2TlDT{l - b'f) 



(Cll) 



where we used Eqs. I|C8I) . (|C9() and exp(X) = Using Eq. (|9"2|) we have 

limAr^ +00 (l + X/N) N for any X. From Eq. ltCTT|) and 
Ti = (r/2)(l - 6?) we derive Eq. @. 



APPENDIX D: NONEQUILIBRIUM DETAILED 
BALANCE INCLUDING INERTIA 



In this Appendix, we give a derivation of Eq. i|93|) . 
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1 m 

-y s + -y s ± v H y s + 2y s + (1 T l)v 

r a 



1 

4D 



1 m 

-y s + -y s ±v-\ y t 

t a 



1 1 m„ . . 

— [-y s ±v+ —y s y s 
D \ t a ' 



If 1 m\l=Fl 

2/s + H & 

L> V r a 



(y s ,~y s ,y s )-P 



(mj/ s + kj/ s ) y s H — u + ay. 



1 ± 1 



= L (±v *> (y s , -y s ,y s ) - f3 [my s (y s + <8v) + ny s y s ] + f3my s -&v 
-(3 (my s + ny s ) —^—v - f3ay s ^^-v 



ds 



^m(y s +dv) 2 + ^ny 2 s 



Ky« 



ITl 



1± 1 



ay s 



my s 



= lW (y s , -y s , y.) - + (3A ±{ y s ,y s , Vs ^ )v 

as 



(Dl) 



where we used Eqs. (|91|l and 194(1 . and •& is a parameter. Equation ((93(1 is derived from Eq. I(D2(I using Eq. 190(1 . 
Equation (jDl|) leads to 
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